Optimal Matrix Product States for the Heisenberg Spin Chain 
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We present some exact results for the optimal Matrix Product State (MPS) approximation to 
the ground state of the infinite isotropic Heisenberg spin- 1/2 chain. Our approach is based on 
the systematic use of Schmidt decompositions to reduce the problem of approximating for the 
ground state of a spin chain to an analytical minimization. This allows to show that results of 
standard simulations, e.g. density matrix renormalization group and infinite time evolving block 
decimation, do correspond to the result obtained by this minimization strategy and, thus, both 
methods deliver optimal MPS with the same energy but, otherwise, different properties. We also 
find that translational and rotational symmetries cannot be maintained simultaneously by the MPS 
ansatz of minimum energy and present explicit constructions for each case. Furthermore, we analyze 
symmetry restoration and quantify it to uncover new scaling relations. The method we propose can 
be extended to any translational invariant Hamiltonian. 



I. INTRODUCTION 

Numerical simulations stand as a fundamental tool to 
analyze strongly correlated quantum systems. Basically, 
two different approaches have proven very powerful. The 
first one corresponds to Monte Carlo simulation, which 
can be applied to most systems with the exception of 
those that present a sign problem. A second approach 
is based on introducing a structured ansatz for e.g. the 
ground state of the system that captures as much of its 
entanglement properties as possible. The kind of struc- 
ture which is best suited for a given system will depend 
on its dimensionality, symmetry properties and geometry 
of interactions. 

A widely used structured ansatz to handle one- 
dimensional systems corresponds to Matrix Product 
States (MPS) [1, 2). The basic idea of this approach con- 
sists of representing states via their correlations rather 
than their coefficients in position or momentum space. 
Quantum states that carry little entanglement are well 
described by MPS [3, 4]. This is the case of one- 
dimensional off-critical states. There, MPS produces a 
very precise approximation to all the properties of the 
state. The MPS approach deteriorates at criticality since 
conformal invariance is recovered and quantum correla- 
tions pervade the system. Yet, MPS remains a useful 
tool in that regime. In higher dimensions, MPS must 
be substituted with the so-called Projected Entangled 
Pairs (PEPs) [5]. A conceptually different structured 
ansatz corresponds to tensor networks that do not en- 
code the standard nearest neighbor topology but, rather, 
a renormalization group tree. Tree tensors and, in par- 
ticular, the Multiscale Entanglement Renormalization 
Ansatz (MERA) [6] may well turn into a powerful method 
to deal with critical quantum systems in any number of 
dimensions . In this paper, we shall concentrate on find- 
ing exact results for the MPS approximation. 

The issue of finding an optimal MPS representation 
for the ground state of an infinite quantum system is not 
trivial. A number of results can be found in the litera- 
ture [7] (and references therein) concerning exact MPS 



in particular cases, exploiting rotational or translational 
invariance. It is also possible, for instance, to rewrite the 
Laughlin wave function coefficients as a product of ma- 
trices [8]. But, in general, exact results are excepcional 
and it is necessary to resort to a specific numerical algo- 
rithm that delivers such a state. In the case of infinite 
systems, two possibilities are at hand: the Density Ma- 
trix Renormalization Group (DMRG) algorithm [9] and 
the Euclidean evolution (iTEBD) algorithm [10]. Both 
methods have been proven to produce the same results on 
examples [11]. Nevertheless, it remains an open question 
whether both algorithms do find the optimal MPS ap- 
proximation to the ground state of a given Hamiltonian. 
It is also unclear how the MPS approximation handles 
the symmetries present in a Hamiltonian. We shall try 
to answer both of this questions in this paper. 

Our approach will exploit the iTEBD approach in an 
analytical way and turn the problem of finding optimal 
MPS to a minimization strategy. Thus, the novelty of the 
method lies in the exactness of this minimization proce- 
dure that allows for an explicit analysis of symmetries in 
the MPS context. We shall present our method and re- 
sults for the particular case of the isotropic spin- 1/2 anti- 
ferromagnetic Heisenberg chain. This thoroughly studied 
model is suited for our purposes since the MPS approxi- 
mation will make a compromise to handle its symmetries, 
as we shall see later on. 

We divide our paper as follows. First, in Sect. II, we re- 
call some basic exact results for the Heisenberg spin chain 
that we use as a testing ground for the MPS approach. 
Sect. Ill is devoted to present the elements of MPS states 
and the iTEBD algorithm. Then, in Sect. IV, we trans- 
form the iTEBD approach into a minimization strategy 
and find exact solutions for MPS states. The analysis on 
symmetry restoration is discussed in Sect. V. 
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II. HEISENBERG SPIN CHAIN 

The isotropic infinite spin-1/2 Heisenberg quantum 
chain is described by the Hamiltonian 



H 



= E^ 



[m,m+l] 



— a ( a m a m+l + °m (T m+l + a m G m+\) i (1) 

m 

where cr^, er^ and <7„ are Pauli matrices at site m. This 
theory stands as a reference model to try new ideas to 
treat strongly correlated systems. There are a several 
reasons that justify its relevance. First, the ground state 
of the Heisenberg spin chain displays critical phenomena, 
that is, long distance correlations dominate the system 
and entanglement entropy of a finite block scales logarith- 
mically with its size [3]. Second, the conformal properties 
of the Heisenberg chain are related to the rotational sym- 
metry of the Hamiltonian. This will be a key ingredient 
in our analysis. Third, the Heisenberg model is exactly 
solvable using the Bethe ansatz [12, 13]. 

Let us be more precise about some of the properties 
of the Heisenberg chain that can be calculated exactly. 
The exact energy of the ground state of this model can 
be worked out via the Bethe ansatz, E = 1/4 — In 2 ~ 
-0.443147181 .... The iTEBD algorithm that we shall 
present later on, will work as a variational method based 
on energy minimization strategy. Therefore, it should 
approach the above result from above. 

The ground state of the Heisenberg Hamiltonian is 
translationally invariant and, as a consequence of rota- 
tional invariance, can be chosen to be an eigenstate of 
the total ^-component of spin, with eigenvalue equal to 
0. These properties constrain the form of the state and, 
thus, its reduced density matrices. Let us analyze this 
point in more detail. 

We start with an arbitrary state \ip). Its 2-body re- 
duced density matrix for two adjacent sites, where all 
spins are integrated out but for the sites m and m + 1 , 
reads 



P[m,m+1] 



trr. 



%+l]\^)(lp\ 



This operator takes the general form 



P[m,m+1] 



odd'/ 
d b c e 
d! c b' e' 
f e e> a' 



(2) 



(3) 



We can now compute the 1-body reduced density matrix 
as a function of the 2-body density matrix parameters. 
Tracing out spin m + 1 we get 



P[r> 



a + b d! + e 
d' + e b' + a' 



(4) 



It is clear that the total amount of parameters that 
describe the 1-body and 2-body ground state reduced 



density matrices should be reduced by the presence of 
symmetries, as it is the case in the Heisenberg chain. Let 
us consider separately how translational invariance and 
rotational invariance simplify the above general discus- 
sion for a finite spin chain. 



1. Eigenstate of the total Z -component of spin 

An eigenstate of the total Z-componcnt of spin with 
eigenvalue A obeys 



N 



(5) 



It is possible to write such a state in the spin basis 



N 



N 



E< 



{-i-i} 

E c ii...tN E ^I'i---^) . ( 6 ) 

m— 1 



where the coefficients c^...^ will be constrained. It is 
straightforward to see that, for a given A, 



' N 

E 



Ac n . 



implies 



N 



E im ^ A 



(7) 



(8) 



Furthermore, we can write the 2-body density matrix as 
a function of the basis elements 



lm.lm + 1 I ■ ■ \ / •/ •/ 

P[m,m+1] — Pi> m i>^ + i \ l m'lm+ll\l m ' l m+l\ 



as 



^C«L.j_i ~ h--i' m i' m+1 ...i N C n—imim+i---iN > 



(9) 



(10) 



where repeated indices are implicitly summed over. 
Then, the constraint (8) imposes 



l m "+" z «i+l r= l m + l m+l > Pi' m l ' m +i ~ 



i+l - (11) 

That is, we find 

P° 1 = pTo = pSS = p°A =/>!? = o , (12) 

which implies 

d = d' = / = e = e' = 0. (13) 
Note, that there is no restriction on the rest of elements 

Of P[m.m+1]- 

It is now necessary to impose that the ground state is 
not a generic eigenstate of the total Z-component of spin 
operator but, rather, 



A = 



(14) 
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However, no constraint on the 2-body reduced density 
matrix will follow from that unless 2-site translational 
invariance is assumed 



P[m,m+1] ~ P[m+2,m+3\ ^ m 



(15) 



Note that this condition is weaker than imposing com- 
plete translational symmetry, yet sufficient to constrain 
the elements of P[ m ,m+i] to obey 



tr (Kfi + ^m+l) P[m,m+1]) = A = Mm 

This further implies 



P°o°o = Pll=a 



(16) 



(17) 



The whole set of constraints we have presented in Eq. 
(12) and Eq. (17) reduce the number of parameters of 
the 2-body reduced density matrix (3) that, now, reads 



P[m,m+i] 



a 

b c 

c V 

a 



(18) 



Note that this form corresponds to the density matrix for 
even sites, m = 2p, whereas for odd sites, m = 2p — 1, 
coefficients b and b' should be exchanged. Furthermore, 
we can compute the 1-body reduced density matrix by 
tracing out one spin from the 2-body one 



P[r, 



a + b 
b' + a 



(19) 



which is diagonal by construction. 



2. Strict Translational Invariance 

The constraint of translational invariance produces a 
different form of the ansatz. For instance, on the reduced 
density matrices, this condition implies 



1] — P[m + l,rn+2] 

that is, 



= p., . 



(20) 



P°ol 


= p\ Q o 


= b 




P°o°i 


= p°J> 


= d 


(21) 


p°A 


= pg 


= e . 





Consequently, the generic expression in Eq. (3) for 
P[m.m+i] wm be casted into the form 



P[m,m+1] 



/ a d d f 
d b c e 
d c b e 

\feea' 



Vm 



(22) 



Note that translational invariance reduces the set of pa- 
rameters in a quite different way as compared to rota- 
tional invariance. 

The 1-body reduced density matrix can be obtained 
by integrating out one of the spins in Eq. (22) 



P\m\ = 



a + b d 
d + e b- 



(23) 



This result remains the same whatever spin is chosen to 
be integrated out, pi m i = P[ m +i]. Note that off-diagonal 
terms are now present, at variance with the rotational 
invariant case. Therefore, these off-diagonal terms can 
be seen as a signature of the lack of rotational symmetry 
in the state. 



3. Quasi Translational Invariance 

The ground state of the Hciscnberg spin chain turns 
out to verify translational invariance up to a sign. That 
is, the ground state is invariant under translating all 
spins by one position if, simultaneously, all of them are 
flipped. This property is rooted at the combination of 
the anti-ferromagnetic character of the Heisenberg inter- 
action and the 2-body nearest neighbor decomposition of 
the Hamiltonian. For the sake of simplicity, we call this 
symmetry "quasi translational invariance". It is, then, 
necessary to modify our discussion on translational sym- 
metry in order to accommodate this effect. It is easy to 
see that the generic restriction stated by Eq. (21) gets 
modified in the following way 



n 01 - 

Poi — 


p\°o 


= b 




-pS8 


= d 


p°A = 


-pi; 


= e 



(24) 



To be precise, some off-diagonal terms include a minus 
sign. Let us note that the expectation value of the energy 
does not depend on this sign. Therefore, the new form 
of the 2-body reduced density matrix reads 



P[m,m+1] 




(25) 



where d<-> — d, e <-+ — e should be exchanged for 
odd/even values of m. The 1-body reduced density ma- 
trix is also different for odd/even values of m 



P[n 



a + b —d + e 
-d + e b + a' 



(26) 



with a sign exchange for d and e. Note that, again, off- 
diagonal terms are present, indicating that no rotational 
symmetry is preserved by this ansatz in general. 
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4- Exact ground state 

Finally, instead of considering symmetries separately, 
let us impose all rotational and quasi translational in- 
varianccs simultaneously on a generic state. This is the 
relevant case of the exact ground state of the Heisenberg 
model. Then, the density matrix form is even simpler. 
From the combination of Eq. (12), Eq. (17) and Eq. (24) 
we obtain the expression for the 2-body density matrix 
of the Heisenberg ground state [14] 



P[m,m+1] 



a 

b c 

c b 

a 



Vm 



(27) 



Only a few parameters {a, b, c} remain undetermined by 
symmetries. 

The 1-body reduced density matrix turns out to be 



1/2 
1/2 



Vm 



(28) 



as a consequence of the unitarity of this reduced density 
matrix. This reflects the fact that each individual spin in 
the system has equal probability to take any value in any 
direction since tr {ozPm) = (Z <-> X , Z <-> Y), as con- 
sequence of rotational and translational invariancc. Note 
that there is no distinction here between the constraints 
coming from strict translational invariance or quasi trans- 
lational invariance. 

Later on, we shall use the 1-body and (adjacent) 2- 
body reduced density matrices as figures of merit to de- 
termine how rotational symmetry or quasi translational 
invariance are maintained within the MPS approxima- 
tion. 



III. MATRIX PRODUCT STATES 

The Matrix Product State ansatz is a powerful tool to 
describe one-dimensional systems with a reduced number 
of parameters. The basic idea underlying this approxima- 
tion is to represent the set of 2 N coefficients that describe 
any state of a iV-spin chain as a product of N matrices 
that can be chosen as follows [4] 



2 

E 

ii...ijv=l 

(29) 

All r[ m l Im objects are x x X matrices and X^ are diag- 
onal matrices of dimension %. The state can be pictured 
as shown in Fig. 1. 

The rational for this ansatz relies on the fact that the 
above construction is the result of a systematic use of 
Schmidt decompositions. That is, at any site k we may 



♦ » ♦ 



JJN-l] p[N] 
— ♦- 



FIG. 1: MPS diagrammatic representation. Each filled cir- 
cle represents a V and each line represents an index. The 
diamonds represent the Schmidt coefficients A. 



divide the spin chain in two pieces. The state can then 
be written as 



\Left a )\Right a ) , 



(30) 



a=l 



where \Left a ) and \Right a ) stand for the states that 
form an orthogonal basis on the left and right parts of 
the chain. 

As a consequence of this Schmidt decomposition, sev- 
eral measures of entanglement can be constructed. The 
most elementary one corresponds to the value of x itself, 
called Schmidt number. For instance, x = 1 on a given 
link means that the state can be divided there as a simple 
product of left and right states. In such a case, there is 
no entanglement between the left and right parts of the 

N 

system. The opposite case of maximum x — 2~ corre- 
sponds to maximally entangled states. From the Schmidt 
decomposition we can also construct the Von Neumann 
entanglement entropy 



x 

E 



xt \osXi 



(31) 



Zero entropy corresponds to uncorrelated partitions, 
whereas a linear scaling of entropy with the number of 
sites in the smaller partition corresponds to maximal en- 
tanglement. 

Extensive efforts have been devoted to understand the 
amount of entanglement which is present in the ground 
states of strongly correlated systems. At quantum phase 
transitions, the entanglement entropy for a block of adja- 
cent spins scales logarithmically with the number of sites 
for critical models [3]. The ground state of the Heisen- 
berg spin chain displays this scaling property. 

Note that the Schmidt decomposition produces natu- 
rally the following isometrics 



E x[ c 



-l] r [m]i 
1 aP 



( x [m 



-l] r [m]i 
1 a/3' 



= 6 



and 



E r [m]i,[m] ( r [m]i,[: 
1 a/3 "V a'/3 A £ 

i,0 



$ a a' 



(32) 



(33) 



This is an instrumental property to simplify the contrac- 
tions of states that have a MPS structure. 
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This approach is closely related to the DMRG ansatz. 
Note that the DMRG algorithm produces a MPS state, 
that is, a state whose coefficients arc represented as a 
product of matrices. This can be translated into the form 
in Eq. (29) using a local symmetry. Indeed, at any point 
between two sites in the product of matrices, we can in- 
sert / = XX^ 1 and reabsorb X and X^ 1 on the adjacent 
left and right matrices respectively. This (gauge) freedom 
can be used to convert the form of the state in such a way 
that Eq. (32) and Eq. (33) are fulfilled. 

The challenge of finding the best set of matrices 
j r [m]; m } 5 {;\H} has a i r eady been faced using numer- 
ical algorithms. We shall here use the iTEBD algo- 
rithm proposed in Ref. [10]. The basic idea consists in 
evolving some initial state in imaginary time. Provided 
that its overlap with the ground state is different from 
zero, the imaginary time evolution converges towards the 
ground state of the system. This strategy can be imple- 
mented using the Trotter decomposition [15] that allows 
to decompose the imaginary time evolution of the total 
Hamiltonian in small steps, each one corresponding to 
the imaginary time evolution of a piece of the Hamil- 
tonian. Moreover, whenever the Hamiltonian is made of 
two-body nearest-neighbor interactions, it can be written 
as a sum of two non-commuting pieces which are made 
of commuting terms. Within each non-commuting sub- 
space, the action of the Hamiltonian on the evolution of 
the state reads as a product of exponentials acting on two 
adjacent sites. Consequently, the state can be described 
by only two different matrices [10] 

p[2m-l] = r [A] ^ p[2m] = p[B] 
A [2m-1] = X [A] ^ A [2m] = ^[B] 



Vm 



(34) 



It follows that the full algorithm reduces to a two-step 
iteration over two sites. 

Let us emphasize that the iTEBD algorithm distin- 
guishes as many sites as the number of terms involved in 
the local interaction. For instance, a Hamiltonian made 
with interactions that involve next-to-nearest-neighbor 
sites would be handled by iTEBD using three type of 
matrices A, B and C and a three-step iteration euclidcan 
evolution. Note as well that, in our case, the iTEBD al- 
gorithm incorporates explicitly two-site translational in- 
variance. 

The choice for the parameter x of the MPS, that is 
the size of the matrices in the ansatz (often called m in 
DMRG literature) controls both the computational cost 
and accuracy of the approximation. Some results for the 
energy and the entropy of the ground state of the Heisen- 
berg spin- 1/2 infinite chain obtained with the iTEBD al- 
gorithm as a function of x are shown in Table I. 



X 


E x 


s x 


2 


-0.427908 


0.48570 


3 


-0.435784 


0.60866 


4 


-0.441058 


0.76413 


5 


-0.442048 


0.84778 


oo 


-0.44314718 


oo 



TABLE I: Comparison between the exact result (labeled as 
X = oo) and the x-dependent iLEBD/DMRG approximation 
for the energy E x and the Von Neumann entropy S x in the 



Heisenberg spin-1/2 infinite chain, 
are precise up to the last figure. 



All numbers in the table 



the Heisenberg Hamiltonian. 
lowest-x cases in detail. 



Then, we shall study the 



A. Exact method 

Instead of resorting to a numerical algorithm in order 
to find the MPS approximation to the ground state of 
the Heisenberg Hamiltonian, we shall construct the ex- 
act form of this approximation by exploiting the isometry 
constraints that the matrices |rl m ] 8m , X^™ 1 ' } obey It is, 
thus, necessary to understand the MPS approach as a 
sequence of Schmidt decompositions rather than the re- 
sult of a DMRG procedure. This is the key point to our 
analytical strategy. 

We first observe that the 2-body reduced density ma- 
trix for a MPS can be written in a simple form as a 
function of the matrices {r^ A ' B ^, A^' B 1 }. That is, the 
combined exploitation of two-site translational symme- 
try and isometrics implies 



tr ( X^T [A]l X [A] T lB]j X [B] X [B] T nB]j ' X [A] T t[A]l ' X [ 



(35) 

Isometries are, indeed, necessary to seamlessly contract 
the infinite chain except for the open physical indices of 
the reduced density matrix. In other words, the above 
expression is only valid in the gauge where the matrices 
forming the MPS are appropriately chosen to fulfill the 
isometry constraints in Eqs. (32,33). 

Once we know the dependence of the 2-body reduced 
density matrix on the MPS matrices, we can easily com- 
pute any observable. In particular, let us write down the 
energy of the system which is the quantity we want to 
minimize. First, we take a local term at sites [m, m + 1] 
for two spins in the Heisenberg Hamiltonian (1) 



IV. EXACT RESULTS FOR MPS 

In this section we shall present an exact method for 
finding the MPS approximation to the ground state of 



2 + 1] 





(I 










1 





-1 


2 





4 





2 


-1 















1/ 



(36) 
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and write its expected value using the form of the 2-body 
reduced density matrix in Eq. (35) 



(h) = tv(ph) = \ - itr (x B M (X B M) ] 



(37) 



where 

M = T [A]l x [A] r [B]2 x [B] _ T [A]2 X [A] T [B]1 X [B] _ /ggN 

This expected value can also be written in a diagram- 
matic form, see Fig. 2. 

aj b j ri A J 3ii A iri B ] A,i B < 



l [i,i+l] 



a.ib] piA] xi A iri B i a,' b i 

FIG. 2: Diagrammatic representation for the expected value 
of a local term of the Hamiltonian. Closed lines represent 
summed indices. 

At this point the set of isometries {T^ 1 , T^} arc still 
general x x X matrices satisfying Eq. (32) and (33). From 
now on we will impose some additional requirements on 
them so as to incorporate the symmetries of the problem. 

For instance, it is possible to impose 

T [A]i = ±T [B]i = pi i X [A] = X [B] = x (3Q) 

in order to implement (quasi) translationally invariance. 
fn such a case, it follows that 



M± = r 1 Ar 2 A qF r 2 Ar 1 A 



(40) 



We, then, conclude that the option of quasi translational 
invariance produces a lower energy than the strict trans- 
lational invariant case. This, as mentioned before, is re- 
lated to the anti-ferromagnetic character of the Heisen- 
berg interaction. 

Alternatively, we can explicitly break translational in- 
variance and set 

T [A]i = (±y T [B)j = pi^ X [A] = X [B] = x (41) 

where i, j — {1, 2}, i ^ j. Then, 

M± = ± (r 1 Ar 1 A qF T 2 Ar 2 A) . (42) 

This case will later be seen on explicit \ examples to 
correspond to a necessary but not sufficient condition to 
maintain rotational invariance. Again, in this case, the 
minus sign is favored by minimization of the energy. 

Both scenarios lead to the minimization of an expres- 
sion of the form 



(h) 



1 1 



-tr 



(XM- (AM-) 1 ) , (43) 



where M_ is given by either Eq. (40) or Eq. (42). In 
order to make further analytical progress, we now turn 
to the particular cases of low values for \- 



B. 



Let us now focus on the simplest case of MPS with 
X = 2. We can exploit in different ways the freedom in 
implementing the isometry conditions on matrices T and 
A to simplify further the MPS ansatz. We shall discuss in 
turn several possibilites that deliver the same minimum 
energy, though not the same state. 



1. Eigenstate of the total Z- component of spin 

As discussed previously, the constraint in Eq. (41) 
allows for the choice of (up to a sign) identical matrices. 
The isometry property leaves enough space to further 
restrict the form of the these matrices without loss of 
generality to be 



(44) 
(45) 
(46) 




X A = X B = 



Then, the expression for the energy takes the form 

(h) = \-\(b±\l\t + \\{a>\ 1 +tf\ 2 ) 2 ) 1 (47) 

and the isometry condition reduces to 

b 2 \\ = 1 , a 2 A 2 + b 2 \j = 1 . (48) 
These isometry conditions can be solved explicitly 



6 2 = 1 a 2 = ^l-i 

A 2 ' Af ' 



(49) 



where wc have used the normalization condition A 2 +A 2 
1. The energy of the system can, then, be written as a 
unique function of Ai 
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= ^-2A 2 -^-2A lV T _ A 2 + ^^i. (50) 



After some algebraic manipulations are performed, the 
minimum of this expression can be reduced to 



4 + 3A 2 - UXf - 8Xl + 16Af = 



(51) 



One of the solutions of this quartic equation produces the 
lowest energy at 



Xumin = 0.94586362... 



(52) 
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E 



X=2 



-0.42790801. 



(53) that yields 



which is the same minimum obtained with numerical 
techniques (see Table I). This result confirms that 
DMRG and iTEBD find numerically the correct min- 
imum for the energy which is consistent with a MPS 
ansatz. 

We can also calculate the correlation length of the MPS 
from the transfer matrix E = £\ (PA) <g) (P*A*). In this 
particular case, E can be written as a function of Ai: 



E 



( 












A, 



- 1 



Ai 

o 





1 \ 




"■-Ml 



(54) 



whose eigenvalues define the correlation length £ 
1/ log (fjj ■ The explicit dependence of £ on Ai is 



&Xi) ^A^^Ml. (66) 



Setting Ai = Xi, m in we find 

£ x=2 = 0.93820167.. 



(56) 



The exact value of the half chain entropy for \ = 2 turns 
out to be 



S 



x=2 



0.48570420... 



(57) 



Finally, following the notation in Eq. (18) we can also 
write down the 2-body density matrix of this MPS 



1 

a! 



2Xf 



b - 
b' 



1 



. 4+ _+4Af 
1 



(58) 



1 - 
1 

a7 



A? 



-2AiU/ 1 -Ai 



and set Ai = Ai 



P[m,m+1] 



( 0.0929 

0.6964 -0.2708 

-0.2708 0.1177 
\ 



\ 




0.0929 / 



Tracing out one spin, the 1-body density matrix becomes 

\ 



P[n 



-1 + 2A? 




2 - 2X\ 



(59) 
Dmes 

(60) 



0.7893 
0.2107 



(61) 



Note that the chosen parametrization leads to an eigen- 
state of the total Z-component of spin (because of the 
block-diagonal form of the density matrices). However, 
the translational invariance is explicitly broken since 

P[m— l,m] P[m,m+1] and also p[ rn ] 7^ P[m+1]- 



2. Quasi Translational Invariance 

A second possibility we can follow corresponds to set- 
ting conditions (39). In that case, we try to find out the 
minimum energy state with matrices T parametrized as 




r [^]2 = 




(62) 



and equal A matrices for all sites. This new parametriza- 
tion can be seen to produce the very same dependence 
of the energy on Ai. Therefore, the minimum energy we 
shall obtain is the same than the first parametrization 
reached. Furthermore, the computation of the correla- 
tion length leads us to the same result as before. Despite 
these coincidences, the state is no more the same, which 
can be inferred from the 2-body density matrix of the 
system: 



A? 



4 2Ai 
4 2Ai 



AiV^A? 



11 

T 



i 

A? 



2X\ 



2Ai 



AixA-Af 



(63) 



\ 2 

4~ Al 



d = e 
d' = e = -d= -e' 



11 1 , 

f 1 \ 2 

■i 4 



x\ 2Al " 



2Ai 



+ X ix l-Xf 



Note that the equalities d = d', e = e' are maintained 
up to a sign, since the condition we require is precisely 
quasi translational invariance. Numerically, the 2-body 
reduced density matrix and also the 1-body reduced den- 
sity matrix take the form: 



P[m,m+1] 



( 0.1146 -0.1447 0.1447 -0.0216 \ 
-0.1447 0.3854 -0.2925 0.1447 
0.1447 -0.2925 0.3854 -0.1447 
\ -0.0216 0.1447 -0.1447 0.1146 / 

(64) 
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P[n 



0.5 0.2893 
0.2893 0.5 



(65) 



The state represented by this MPS is not an cigenstate 
of the total Z-component of spin, but quasi translational 
invariance is recovered. The two parametrizations we 
have analyzed deliver the same energy but handle differ- 
ently the original symmetries of the problem. The result- 
ing MPS will give different results on local observables 
attached to these symmetries. We may also consider a 
MPS which is not forced to take the form imposed by any 
symmetry. Such new state would still deliver the same 
energy and differ on other observables. 



C. X > 3 

We can also follow similar steps for higher values of X- 
In particular, let us apply the constraint discussed in Eq. 
(41) for matrices of x — 3. This requirement allows us to 
choose a rather simple form of the matrices 



r [A]l 












(o 


b 




(: 





• 


T [A]2 = 


b 





i) 











1° 


d 





(66) 



which generalizes the form of matrices Y in Eq. (46) for 
X = 2. 

Note that the number of parameters that describes the 
state can be reduced by considering the isometry and 
normalization conditions 



a 2 \\- 
b 2 \\- 
2 \\ + 
acX 2 - 



b 2 X 
d 2 \ 



d 2 X 2 2 + e 2 \\ 
- bd\\ + ce\j 



! \i = l 



(67) 







As a consequence of this reduction, the energy of the 
state can be expressed, after some algebra, as a func- 
tion of only three parameters. Therefore, the problem 
of finding a good approximation to the ground state of 
the Heisenberg Hamiltonian turns into a three-variable 
function minimization. The solution is again the same 
as numerical algorithms reach with no constraint on the 
matrices 

E x=3 = -0.435784... (68) 

and the reduced density matrices take the form 

/ 0.0930 \ 

0.6429 -0.2788 

-0.2788 0.1711 

\ 0.0930 / 



P[m,m+l] 



P[n 



0.7359 
0.2641 



(69) 
(70) 



We observe that again the 2(l)-body reduced density 
matrix of the MPS clearly violates translational invari- 
ance. Nevertheless, in analogy to the x — 2 case, we can 
require quasi translational invariance conditions on ma- 
trices r, such that Eq. (39) is fulfilled. In this case, we 
have found the particular form 

a b c \ I a —6 c 

r^ 1 =|-6 o d\ r^ 2 = \ b o -d | 

: — d el \ c d e 

which produces the solution (68) as well. However, de- 
spite obtaining the same minimum, the MPS is different 
from the previous one. This can be explicitly seen from 
the density matrices 



P[m,m+1] 



( 0.1106 
-0.1180 
0.1180 
\ -0.0176 



P[m,m+1] 



-0.1180 
0.3894 

-0.2964 
0.1180 



0.1180 
-0.2964 
0.3894 
-0.1180 



0.5 0.2359 
0.2359 0.5 



-0.0176 \ 

0.1180 
-0.1180 

0.1106 / 
(72) 

(73) 



In this second case, quasi translational symmetry is pre- 
served, but the rotational invariance is clearly broken. 

A similar reasoning can be followed in regard to higher 
X MPS, looking for a generalized form of matrices T and 
addressing the minimization of the energy by reducing 
the number of parameters that describes the MPS. We 
shall quote some of the results obtained in the case of 
higher x m the next section. 



V. SYMMETRY RESTORATION 

The faithfulness of the MPS approximation to the 
ground state of a given Hamiltonian depends on the value 
of parameter x- We refer the reader to the extensive anal- 
ysis of scaling relations performed in Refs. [11, 17]. It is, 
there, shown that the finiteness of x produces an effective 
correlation length in the system 



(74) 



with k = 1.37(1) for the Heisenberg spin chain. In the 
present case, we shall analyze a different effect, namely 
the breaking of the symmetries of the problem as a func- 
tion of X- 

As discussed along the previous section, the MPS 
ansatz does not preserve all the symmetries of the ex- 
act state to be represented. Therefore, the symmetry 
breaking generated by this approximation should also be 
described as a function of x- I n particular, for the limit 
X — ► oo all the symmetries of the state described by the 
MPS should be completely restored. 
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In order to quantify the symmetry breaking of a MPS 
with parameter x, we need to construct a figure of merit 
from the representation of the state. We shall present 
such a construction via an example. Let us write down 
a generic MPS for x = 2 obtained with the iTEBD algo- 
rithm with no restriction on the form of L matrices 



P[m,m+\] 



( 0.0972 -0.0725 0.0554 -0.0042 \ 
-0.0725 0.6623 -0.2751 0.0725 
0.0554 -0.2751 0.1433 -0.0554 
\ -0.0042 0.0725 -0.0554 0.0972 / 

(75) 



0.7595 0.1279 
0.1279 0.2405 



(76) 



Note that these reduced density matrices cast into the 
form stated by Eqs. (3,4). In particular, let us focus on 
the 1-body reduced density matrix and write it as 



y 



y 



(77) 



where the property tr (p\m\) = 1 has been used. 

We see that the 1-body reduced density matrix is de- 
scribed by only two parameters {x, y} that parametrize 
the deviation from the exact ground state. Indeed, with 
this notation, the 1-body reduced density matrix of the 
ground state of the Hciscnberg chain corresponds to the 
setting {x = 0, y = 0} (sec Eq. (28)). Therefore, these 
parameters account for the symmetries breaking of the 
MPS approximation. 

This short description allows to compare again the two 
regimes studied above, namely the preservation of either 
rotational symmetry or quasi translational invariance. 
Let us summarize in Table II the results of the previous 
section together with the generic 1-body reduced density 
matrix obtained with the iTEBD algorithm for \ = 2. 





Gen 


Rot 


qTr 


X 

y 

Afi = 2^/x 2 + y 2 


0.2595 
0.1279 
0.2893 


0.2893 


0.2893 




0.2893 
0.2893 



TABLE II: Comparison between the parameters of the 1-body 
reduced density matrix (see Eq. (77)) of a MPS with \ = 2 
in the following cases: generic (Gen), rotational invariance 
(Rot) and quasi translational invariance (qTr). Note that 
A/i is identical in all cases as it corresponds to the unique 
invariant coming from the eigenvalues of the 1-body reduced 
density matrix. 



from the 1-body reduced density matrix an observable 
that shall not depend on the gauge. 

Since the elements of the density matrix depend ex- 
plicitly on the local basis, the unique parameters that 
are invariant under local unitary transformations shall 
be its eigenvalues, that we call {/Lti,/^}- Furthermore, 
note that the trace of the 1-body reduced density matrix 
is also constrained to be equal to one. Therefore, the only 
gauge-invariant parameter that remains is the difference 
of the eigenvalues 



Afi = hi - fi 2 = 1\fxF 



ir 



(78) 



which can be read explicitly as a function of parameters 
{x,y}- 



< 




0.04 



X 



FIG. 3: Restoration of the broken symmetries parametrized 
by the difference of eigenvalues A/i = fj,i ~ P% of the 1-body 
reduced density matrix gauge-invariant parameter. 



The quantity A/i does not depend on the gauge and 
accounts for the faithfulness of the approximation. The 
freedom in implementing the isometry conditions on the 
matrices of the MPS allows to choose a particular form 
in which this approximation is performed. This choice 
is eventually a particular parametrization {x, y} of the 
same amount of symmetry breaking A/i. Furthermore, 
this invariant observable shall depend on the parameter 
of the approximation, x- Some results are shown in Fig. 
3. The best fit to our data corresponds to a scaling law 
of the form 



-b 



Afi = ax 
0.88 ±0.03 b = 0.65 ±0.02 



(79) 



The results from Table II show explicitly the differ- 
ences between the states represented by MPS with dif- 
ferent symmetries preserved. Nevertheless, all of them 
correspond to the very same values for the energy and the 
entropy In such a case, we should be able to construct 



with high accuracy as seen in Fig. 3. 

It is natural to expect the exponent b to be related to 
the general critical exponent n introduced in Eq. (74), 
since both of them parametrize the effects due to the 
finitcness of x- 
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VI. DISCUSSION 

Beyond the well-known numerical strategies for com- 
puting a Matrix Product State approximation, exact re- 
sults for the ground state of a low dimensional MPS 
can be found using an analytical minimization strategy. 
The arbitrariness in the paramctrization of matrices T 
allows us to choose a simple structure for these matrices 
so that the minimization problem can be solved analyti- 
cally. This simplification is guided by the symmetries of 
the problem. 

A number of results emerge from our anaytical ap- 
proach. First, the exact minimum found for low x cases 
agrees perfectly with the numerical results obtained with 
iTEBD or DMRG. This means that both methods avoid 
local minima and find the optimal solution consistent 
with the MPS ansatz. Second, a generic MPS does not 
preserve any symmetry of the problem beyond the 2-site 
translational invariance due to the fact that the algo- 
rithm looks for a minimum of the Hamiltonian expec- 
tation value. Thus, for the Heisenberg chain, the 1-site 
translational invariance of its ground state, and the prop- 
erty of being eigenstate of the total ^-component of spin 
are explicitly violated. However, it is possible to con- 
strain the MPS to preserve one of them while remaining 



an absolute minimum for the energy. Yet, if both sym- 
metries are imposed at the same time the MPS ansatz 
does not get down to the same minimum. 

For low-x MPS it is not difficult to find the suitable 
parametrization that allows us to preserve a chosen sym- 
metry, as we have shown on examples. It is also possi- 
ble to quantify symmetry restoration using, as a figure of 
merit, the difference of eigenvalues of the 1-body reduced 
density matrix. We observe that symmetry gets restored 
when x increases following a detailed scaling law. 

The method we have presented can be extended to any 
local Hamiltonian that displays translational invariance. 
This is the key ingredient to reduce the computation to a 
simplified minimization. Beyond nearest-neighbor inter- 
actions or higher spins can also be accommodated with 
straightforward extensions of the iTEBD algorithm. 
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